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The article presents the application of fixed lag smoothing algorithms to the problem 
of estimation of the phase and frequency of a sinusoidal carrier received in the presence 
of process noise and additive observation noise. A suboptimal structure consists of a 
phase-locked loop (PLL) followed by a post loop correction to the phase and frequency 
estimates. When the PLL is operating under a high signal-to-noise ratio , the phase detector 
is approximately linear, and the smoother equations then correspond to the optimal 
linear equations for an equivalent linear signal model. The performance of such a smoother 
can be predicted by linear filtering theory. However, if the PLL is operating near the 
threshold region of the signal to noise ratio , the phase detector cannot be assumed to be 
linear. Then the actual performance of the smoother can significantly differ from that 
predicted by linear theory . In the article we present both the theoretical and simulated 
performance of such smoothers derived on the basis of various models for the phase and 
frequency processes. 


I. Introduction 

The derivation of optimum receivers through modern esti- 
mation techniques has been proposed by various researchers 
(see Refs. 1-12 and their references). In Refs. 4 and 5 opti- 
mum zero lag receivers have been derived on the basis of linear 
Kalman filtering theory (Ref. 6) for linear measurement 
schemes. The nonlinear measurement situations which are of 
interest here have been studied in Ref. 7, wherein, on the basis 
of nonlinear filters of Ref. 8, suboptimal nonlinear zero lag 
receivers have been derived for the demodulation of angle 
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modulated signals. In Ref. 9 the techniques of Refs. 7 and 8 
have been extended to design suboptimum fixed lag smoothers 
for phase estimation. The solution of the optimum nonlinear 
filtering/smoothing problem is, of course, intractable. Whether 
derived from linear or nonlinear theory, the smoother struc- 
ture consists of a phase-locked loop (PLL) followed by a post 
loop correction to the phase and frequency estimates. 

In this article we study the application of linear and non- 
linear smoothers to the phase and frequency estimation of a 
sinusoid. We show that for this case, the suboptimum non- 
linear smoother derived from Refs. 7-9 is not substantially 
different from the optimum linear smoother equations for an 
appropriate linearized measurement model. In addition, simu- 
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E[v(k)] = 0 , E[w(k)] - 0 


lations show that the difference in performance of the non- 
linear and linear smoother is not significant, even when the 
phase detector is operating highly nonlincarly. Even though 
the linear and nonlinear systems perform similarly, linear 
theory is inadequate to predict the performance when the 
phase detector is highly nonlinear. 

When compared to the case of linear phase detector, the 
performance of the smoother for the case of nonlinear phase 
detector can be substantially different. The difference can be 
much more pronounced when process noise is present, com- 
pared to the case when only observation noise is present. The 
simulation examples indicate that in the absence of process 
noise, although there is a significant performance degradation 
due to nonlinearity (about 1 dB when operating in the loop 
SNR of about 5 dB), there is no threshold observed in the 
smoothing error covariance in this region. In contrast to this, 
there is a pronounced threshold in the smoother performance 
when the process noise is present and the inverse of filter 
phase error variance is below 7.5 dB. 

We also evaluate the smoother performance when the pro- 
cess noise is reduced in magnitude. That is, the smoother/ 
filter solutions are based on a relatively high process noise, 
but in the simulation the actual variance of the process noise 
used is lower or zero. This is of interest because, in many 
practical applications, the process noise statistics are not pre- 
cisely known, and are therefore deliberately over-estimated. 


II. Signal Model and Smoother Equations 

In this section, we present a suboptimal nonlinear smoother, 
and show that it is very similar to the linear solution. We then 
present an implementation of the linear solution. We consider 
the problem of estimating the phase process 6(k) from the 
sampled version of the received carrier signal y (fc), i.e., 

y(k) = Ay/ 2 sin (co,r fc + 8 (fc)) + v (k) ( 1 ) 

where t k is the fcth sampling time, to c is the known carrier 
frequency and v(k) the observation noise is the sampled ver- 
sion of a narrow band zero mean white Gaussian noise process 
v(r). Furthermore, the phase process 6(k) is modeled as 

6(k) = £' = [1 0 . . . 0] 

( 2 ) 

jc(fc+l) = 4> x(fc) + vv(fc) 

In Eq. (2), 0 is the phase constant, x(k) is the state vector 
of dimension n, <l> is an (n X n) matrix and w(k) is zero mean 
white Gaussian noise process independent of {y(k)} . Thus 


£[F 2 (A:)] = R ; £-[w(*)w r <*)] = Q ; £[?(*) w(/)] = 0 

As shown in Refs. 9 and 10, when 2cj c t and higher order 
harmonic terms are ignored, the smoother equations reduce to 
the following: 

5c 0 (*+l) = <t>x 0 (k/k) + K 0 (k+\)v(k+\) \ 

5c. (k + \/k + 1) = x t l {k/k) + K.(k + 1) r)(k +1) I 

r)(k + 1) = \/Ty{k + 1) Cos(©(/: + 1)) / (3) 

0(* + l) = c o c t k+l +/5£x(*+l/*) \ 

x.(k) = x(k - i) , i = 0 ,L I 

where x t (k/k) represents the filtered estimate of x f (k) or the 
smoothed estimate 5c(fc - i/k ). The gain vectors K f and the 
cross covariance matrices p i0 (k/j) = Em - i/j > xT( k /i)} 
with x{kH) = x(k) - x(k/j) are given by 

K.(k + 1) = A pP jQ {k + 1/*) £ + 1) , 

0</<£ (4) 

P. 0 (k+l!k+ 1) = P jQ (k + l/k) 

-P i0 (k+ Uk)(A0mA(ny 
XP 00 (k+llk)S~ l (k+\) (5a) 

P. Q (k + l/k) = P._ y Q (k/k) d»' , 0 <i<L 

(5b) 



P* = 0 2 Poo U ’ * (k) = Rik)IAl (6) 

The smoother error covariance matrix P u (k + l/k + 1) is 
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P..(k+ Ilk +1) = P..(k + 1 lk)-P. 0 (k + 1 Ik) (. A p 2) 


XS~'(k + l)(Ap£)’P; 0 (k+l/k) 


P u {k+llk) =P i _ li _ 1 Wk) (7) 

A. Rapprochement With Linear Theory 

Representing the bandpass additive noise v(k) in terms of 
its baseband quadrature components?^/:) and ? <? ( k), ignoring 
the 2co c term, then for small estimation error lc{k + 1 //:), 


n(k+\) = a A i'x(k+\/k) + -^=v.(k+l) 

y/2 ‘ 


( 8 ) 


The r?(A: + 1) given by Eq. (8) above is precisely the one-step 
ahead prediction error (innovation) for the following linear 
model 


y(k+ 1) = pAi' x(k+ l) + -j=-v.(k + \) (9) 

It is easily verified that Eqs. (3-7) reduce to the linear 
optimal smoother equations for the model (Eqs. [2,9]), under 
the assumption of small p 


their steady-state values in Eqs. (3-7), these difference equa- 
tions are replaced by algebraic equations and may be solved 
explicitly for the steady state values of the filter error covari- 
ance matrix P F , the prediction error covariance P p , smoother 
error covariance P s , etc. Substitutions of these expressions in 
Eq. (4) and the linearized version of Eq. (6) results in the 
steady-state expressions for the filter and smoother gains. 
Finally, from Eq. (3) the filter and smoother transfer func- 
tions and various other transfer functions of interest are 
derived. These expressions are very useful in evaluating the 
error performance of the filter/smoother when the design 
value of the process noise covariance matrix is different than 
its actual value. In such cases, the expressions derived for the 
filter/smoother covariance matrices do not reflect the actual 
performance. The various error variances are instead evaluated 
using frequency domain techniques from the derived transfer 
functions. One may refer to Ref. 10 for the details of such 
derivations. 

The above derivations are based on the assumption of 
linear phase detector. The performance predicted on the basis 
of these expressions is compared with simulations in the next 
section. As would be observed there, under the assumption of 
linear phase detector, the simulation results are in close con- 
formity with those predicted from theory. 


B. Smoother Implementation 

If the various gains are replaced by their respective steady 
state values, the smoother consists of a digital phase-locked 
loop followed by a post-loop correction to the filtered esti- 
mates. As shown in Ref. 10 this post-loop correction can be 
equivalently implemented by a finite impulse response (FIR) 
filter whose output e{k + 1) is related to its input r\{k + 1), as 
in Fig. 1, by 

e(k +1) = r\{k + 1) + 7- 1 -q(k) + . . . + y-V'-V v (k + 2 - L) 

( 10 ) 

The scalar 7 in Eq. (10) can be expressed in terms of steady 
state filter error covariance matrix, etc., as shown in Ref. 10. 

III. Linear Filter/Smoother: Derivation of 
Transfer Functions and Performance 
Expressions 

In Ref. 10, three specific cases of model (2) are considered. 
These correspond to the dimension n of the state vector * 
in Eq. (2) equal to 1,2, and 3. The resulting filter/smoother 
configurations are termed first order, second order and third 
order respectively. By replacing various gains and matrices by 


IV. Simulation Results 

In the following the simulation results obtained for the 
second-order case are presented in some detail. We discuss 
the performance of the optimal linear filter and smoother 
both with linear phase detectors first. Then we evaluate 
the smoother performance versus delay and lastly discuss the 
smoother performance with the nonlinear phase detector. To 
be concrete we use the following often used model for the Q 
matrix 



One advantage of using the above Q is that the performance of 
the filter/smoother is then a function of only three parameters 
viz, a a , a- and T, where 0 $ denotes the noise variance of 
v t -(k)l\/2 in the baseband model, Eq. (9). We present the 
smoother/filter performance in terms of the- phase estimation 
error. One may refer to Ref. 10 for the corresponding results 
for the frequency estimation error. 

First we present the phase tracking performance from 
both analysis and simulations for the case when the phase 
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detector nonlinearity is ignored. Both the optimal filter and 
smoother performance are analyzed in the following. 

1. Optimal filter and smoother with large delay. Here we 
present the performance of the optimal filter and smoother 
(assuming linear signal model) so as to relate these parameters 
to the two-sided normalized loop noise bandwidth 2 B p , a 
commonly used parameter in the design of phase locked loops. 
We consider the smoother with large delay. In terms of the 
closed-loop transfer function matrix G F (z ) (Ref. 10), the 
parameter 2 B p is given by, 

(,2) 


The real two-sided noise bandwidth of the filter 2 B Lp = 
2B l /T and is equal to the normalized phase error variance 
P F (\,\)I (cr^T) when the actual process variance a 2 s = 0. 

Similarly 

2B lr.s " 2B P ,sl T ' F sV-'H (V 7) 

In Fig. 3 we plot the normalized phase error variance for 
both the filter and smoother as obtained from the recursive 
solutions of Eqs. (4-7). From the figure approximate expres- 
sions for these terms may be written as, 

P/UVoJr = 0.75 (a a 2 /<7- 2 ) 008 , T= 1 s, a 2 /a3 < 10 


where G Fp represents the first component of the transfer 
function matrix G F (z), and T is some appropriate contour of 
integration. Figure 2 plots B p as calculated from Eq. (12) as 
a function of (o a 2 /a- 2 ) for three different values of the sam- 
pling period T viz. 0.01, 0.1 and 1 s. From these graphs it is 
readily seen that approximately. 


/ o n o.n 

2 B s 0.67 (o 2 1 o- 2 ) 7\ 

p \ a 1 v I - 

/ O 'M 0226 

2B n as 1.01 [a 2 la- 2 ) T , 

p \ a 1 v I 

l °- 2 5 

2 B s 1.05 o V T, 

p V a 1 v ! J 


T = 1 s, o 2 la- 2 < 10 

a 1 v 

T = 0.1 s 
T = 0.01 s 


(13) 

The last relation may be taken to be the asymptotic relation 
for (2 B p jT) as T + 0. Figure 2 also includes the normalized 
loop noise bandwidth of the smoother as calculated from 
Eq. (12) with G F replaced by the first component of the 
smoother transfer function matrix. Denoted by 2 B pS this 
normalized bandwidth is given by 

2 B pS a 0.28 [a 2 /a 2 )°' 234 T , T = 0.1 s (14a) 
Comparison with the filter bandwidth of Eq. (13) yields 

B pl B P,S = 3 - 6 (°a l°v ) - r = 0.1 S (14b) 


This indicates that the improvement achievable by using 
second order smoothing compared to a second order filter is 
approximately a factor of 3 • 6 or 5.5 dB. 


/ O ^°- 22 

= 1-32 (o>- 2 ) .7-= 0.1s 

0.2 5 

= 1.4 (a 2 la 2 ) , 7= 0.01 s (15a) 

^ ^ . 0.237 

P s (\mo 2 T) = 0.365 a 2 /aJ (15b) 


Comparing Eqs. (15) and (13,14) one observes that pro- 
vided an optimum filter or smoother is used, the maximum 
degradation of the phase error variance is only about 1.34 
(1.25 dB) and this is almost independent of the variance a 2 . 

2. Optimal smoother performance with linear phase de- 
tector. In Fig. 4 is plotted the smoother performance evalu- 
ated from simulations as a function of the smoother delay and 
the ratio (a fl 2 /a- 2 ) used in the smoother design, assuming 
linear phase detector. The dotted curves in the figure plot the 
two-sided normalized loop noise bandwidth as computed from 
Eq. (12). As may be inferred from the figure, the two measures 
of performance are equal within the limits of statistical errors. 
The minimum phase error variance (corresponding to L = -) 
varies over a range of about 0.3 to 1.4 for (a fl 2 /a- 2 ) between 
1 to 100. It is also apparent from the figure the fact that 
the number of delays required has an inverse relation to 

(' a a 2 Jo y 2 ) to achieve asymptotic smoother performance. In 
Fig. 5 is plotted the real loop noise bandwidth 2 B Lp S as a 
function of normalized smoother delay (ZT/r^), where t f is 
the time constant of the optimal filter. As is clear from the 
figure, the normalized value of delays required to achieve 
asymptotic smoother performance does not depend signifi- 
cantly upon (o a 2 1 o- 2 ). 

Figures 6 and 7 plot the results similar to those of Figs. 4 
and 5 respectively, when the actual process noise variance 
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equals its design value, i.e., a 2 s = a 2 . A comparison of these 
two sets of figures shows that the phase error variance can be 
at most 1.35 times more than for the case of o 2 s = 0. For 
intermediate values of the noise variance, 0 < a 2 5 < a 2 , the 
ratio would be smaller. 

In Fig. 8, a comparison of smoother phase error variance is 
made for three different sampling periods T equal to 0.01, 0.1 
and 1 s respectively. As is evident from the figure, whereas the 
optimum filter performance is dependent upon the sampling 
period, the asymptotic smoother performance depends only 
marginally on T . Thus the smoother in the most part compen- 
sates for any loss of optimality due to finite sampling period. 
This means that smaller T can be used with smoothing than 
with filtering only. 

3. Smoother performance with nonlinear phase detector. 

Figures 9 and 10 present the simulation results for the case of 
( o a 2 = o- 2 ) corresponding to a two-sided noise bandwidth of 
the filter equal to 1 Hz. For this filter design and in the absence 
of the process noise [o 2 s = o) , the effect of nonlinearity is 
to degrade the normalized phase error variance P s ( 1,1 )/a^ 2 by 
at most a factor of 1.32 for a- 2 <2.2 (corresponding to the 
filter rms phase error of 27° for linear detector and 30° for 
nonlinear phase detector). 

For the case of o 2 s - a 2 , the normalized phase estimation 
error variance depends much more strongly on a- 2 . For 
a- 2 <1.4 (corresponding to rms phase error of 28.5 degrees 
at the phase detector output), the degradation is within a 
factor of 1.7 (2.3 dB). The degradation can be much higher for 
larger values of a- 2 . 

From these simulations it may also be inferred that for 
°ls = 0, and for the case of linear phase detector, the smoother 
provides an improvement of 5.6 dB over the filter. When the 
phase detector nonlinearity is taken into consideration, then 
for a range of 10 log (l/a|) > 6 dB, with o\ denoting the 
phase error variance of the PLL with linear phase detector, the 


smoother still provides an improvement of at least 5.1 dB over 
the filter. Note, however, that the filter performance can itself 
be degraded by as much as 1.5 dB due to phase detector non- 
linearity. Since these results correspond to a fixed value of B L , 
it may be concluded that with a smoother, the receiver can be 
operated with at least 3.5 dB smaller carrier power to noise 
spectral density ratio (PJN 0 ) when it is desired to have 0.1 or 
smaller value for the phase error variance. 

For the case of a 2 s = o 2 , it is observed that the effects of 
nonlinearity are more dominant resulting in a threshold behav- 
ior in the smoother phase error variance. However, for 10 log 
(. P C /N Q B l )> 7.5 dB, the results in terms of smoother perfor- 
mance are close to those for the case of o 2 s = 0. 


V. Conclusions 

The article has presented the performance of suboptimal 
filter and smoother for the phase and frequency estimation of 
a sinusoidal carrier under the presence of both the process 
noise and observation noise. The performance predicted on the 
basis of linear estimation theory is in close conformity with 
the corresponding results obtained with simulations, when the 
phase detector is assumed linear. Similar results are applicable 
when the phase detector nonlinearity is taken into account 
and the receiver is operating under high SNR conditions. 
Under these conditions the smoother improves both the phase 
and frequency estimation error compared to the filter by 
about 6 dB. 

However, as the SNR is reduced, the corresponding im- 
provement is less. Also the reduction is more when the process 
noise is present than when only the observation noise is 
present. Overall taking into account the degradation caused by 
the nonlinearity in the performance of filter, the smoother can 
permit the receiver operation at about 3.5 dB smaller carrier 
power to noise spectral density ratio when it is desired to have 
0.1 or smaller value of the phase error variance. 
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LOOP FILTER 



Fig. 1. An equivalent and simpler implementation of the smoother 



SECOND ORDER SMOOTHER 


□ T =0.1 s 



Fig. 2. Normalized loop noise bandwidth of the second order filter/smoother vs 7 2 ) 











NORMALIZED PHASE ERROR VARIANCE 



Fig. 3. Normalized phase error variance vs with <rj s = o-jj 
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NORMALIZED PHASE ESTIMATION ERROR VARIANCE, P s (1, D/o'* 



Fig. 5. Normalized smoother estimation error variance vs 
normalized delay (<r| s = 0) 



Fig. 4. Smoother estimation error variance vs smoother delay 

("Is = 0) 
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NORMALIZED PHASE ESTIMATION ERROR VARIANCE, P s (l,1)/cr 



0 10 20 30 


SMOOTHER DELAY L 




Fig. 7. Normalized smoother estimation error variance vs 
normalized delay (<xf s 




NORMALIZED PHASE ESTIMATION ERROR VARIANCE, P s (1,1)/(cr£T) 



Fig. 8. Smoother performance for different sampling periods 



Fig. 9. Comparison of smoother performance with linear and 
nonlinear phase detectors (cr'j s = 0) 
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INVERSE OF PHASE ERROR VARIANCE 



10. Comparison of smoother performance with linear and 
nonlinear phase detectors {cr\ s # 0) 




